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d) after said traromitting or storing, in response to the resulting delayed audio, 
developing a second marker corresponding to said marker of c); 

e) in response to the relative timings of said marker of c) and said second marker, 
delaying the least delayed of said delayed audio and said delayed video. 

Claim 30. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is engrafted onto the luminous portion of said video. 

Claim 31. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is combined in the active portion of said video. 

Claim 32. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is combined in the active portion of said video in an unobtrusive manner. 

Claim 33. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is combined in the active portion of said video 

Claim 34. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is engrafted onto the luminous portion of said video as a watermark. 



Applicant believes authorization to charge deposit account 16-1940 for the 
additional claims presented herein was included with the application as filed, however 
in the event applicant is mistaken, please consider this statement an authorization to 
make such charges to deposit account 16-1940. 

Attached hereto is a marked-up version of the changes made to the specification 
and claims by the current amendment. The attached page is captioned " Version with 
markings t o show changes made." These changes include amending the specification 
to reflect the issuance of the parent application as patent 6,351,281 and the addition of 
new method claims recited in step plus acts form. 

It is noted that the parent application fully supports at least the independent 
claims 16-18, 28 and 29. For example, the particular limitation of providing a marker 
in response to the ancillary or audio signal in step a) is taught in the parent application. 
For example at column 4, lines 21-25 of the '281 patent issued from the parent 
application it states: 

Note that while an added pulse 21 from the generator 20 is 
preferred, certain parameters, characteristics or ancillary signals (herein 
called artifacts) already present in known signals could be utilized as 
tracker pulses 21. 
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The tracker pulse of '281 may take on many forms and corresponds to the marker of 
the present application. Additionally, the claim elements "parameter" of claim 19 and 
"characteristic" of claim 20 are taught in the parent application for example as in the 
section above. 

The claim 22 and 23 features relating to amplitude modulation of the marker and 
engrafting the marker on the luminous portion of the video is taught in the parent 
specification. For example *281 at column 4, lines 10-20 states: 

This tracker pulse is generated in recognition with the type of signal 
together with the processing which will or is expected to occur thereon. 
For example, with a NTSC video transmission system, the tracker pulse 
could be an amplitude modulated pulse engrafted onto the luminous 
portion of the signal. It is preferred that the tracker pulse be invisible or 
imperceptible to the ultimate use to which the signal will eventually be 
applied. 

This language also precisely fits the use of a watermark as in claims 24 and 25. 
Watermarks are commonly digital pulses which are added to the luminance portion of 
the video, i.e. while there are various types of watermarks, the luma is commonly 
amplitude modulated by the digital watermark information. The use of watermarks is 
also taught in the present specification, for example at page 11, line 10 et. seq.. 

A copy of 6,351,281 is enclosed for the examiner's convenience. 

Applicant respectfully requests that a timely Notice of Allowance be issued in 
this case. 



I hereby certify that this correspondence is being facsimile transmitted to the U.S. 
Patent and Trademark Office (Fax No. (703) 308,5399 on March 6, 2002, 




J. Carl Cooper 
Reg. 34,568 
(408) 871-1975 




J. Carl Cooper 
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VERSION WI TH MARKIN GS TO SHOW CHANGES MADE 



In the specification: 

The first paragraph beginning at line 4 of page 1 has been amended as follows: 

This application is a Continuation In Part to S/N 09/119,524 filed 07/21/98, 
now patent 6351.281 issued 02/26/02 which is a division of S/N 08/620,126 filed 
03/21/96 which receives priority from provisional application 60/008,309 filed 
December 7, 1995, which applications are incorporated herein in their entirety and for 
all purposes as if they had been set forth in detail. 

In the claims: 

Claim 16. A method of determining the synchronization of a video like signal and at 
least one corresponding ancillary signal, which signals mav suffer differing relative 
delays to become delayed ancillary and delayed video like signals, said method 
including the steps of: 

a) developing a marker in response to said ancillary signal: 

b) associat in g said marker with said video like sig nal; 

c) recovering said marker from said delayed video like signal: 

d) developing a second marker corresponding to said marker of c) from said delayed 
ancillary signal: 

e) determining said synchronization in response to comparison of the timing of said 
marker of c) relative to the timing of said second marker. 

Claim 17. A method of maintaining the sy nchronizat ion of a video like signal and at 
least one corresponding ancillary signal which mav suffer differing relative delays due 
to processing thereof which results in delayed ancillary and delayed video like signals, 
said method including the steps of: 

a) developing a marker in response to said ancillary signal: 

b) associating said marker with said video like signal: 

c) recovering said marker from said delayed video like signal: 

d) developing a second marker corresponding to said marker of c) from said delayed 
ancillary signal: 

e) in response to the timing of said marker of c) relative to the timing of said second 
marker, delaying the leas t delayed of said delayed ancillary and said delayed video like 
signals thereby correcting errors in said sy nchroni zation. 

Claim 18. A method of indicating the relative delay of a video like and at least one 
corresponding ancillary signals which mav suffer differing relative delays as a result of 
processing to become delayed ancillary and delayed video like signals, said method 
including the steps of: 

a) developing a marker in response to said ancillary sig nal: 
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b) associating said marker with said video like signal: 

c) recovering said marker in response to said delayed video like signal: 

d) developing a second marker corresponding to said marker of c) from said delayed 
ancillary signal: 

e) indicating said relative delay in response to comparison of the timing of said marker 
of c) relative to the timing of said second marker. 

Claim 19. A method as claimed in claim 16, 17 or 18 wherein said marker of a) is 
responsive to a parameter of said ancillary signal. 

Claim 20. A method as claimed in claim 16. 17 or 18 wherein said marker of a) is 
responsive to a characteristic of said ancillary signal. 

Claim 21. A method as claimed in claim 16. 17 or 18 wherein said marker of a) is also 
responsive to said video like signal. 

Claim 22, A method as claimed in claim 16. 17 or 18 wherein said associating said 
marker with said video like signal of step b) includes engrafting said marker onto the 
luminous portion of said video like signal. 

Claim 23. A method as claimed in claim 16. 17 or 18 wherein said associating said 
marker with said video like signal of step b) includes engrafting onto the Tiirrrinrnis 
portion of said video like signal by amplitude modulation. 

Claim 24. A method as claimed in claim 16. 17 or 18 wherein said associating said 
marker with said video like signal of step b) includes encoding said marker as a 
watermark in said video like signal. 

Claim 25. A method as claimed in claim 16. 17 or 18 wherein in step b) said marker is 
associated with said video like signal by conveying said marker as a watermark in said 
video like signal and in step c) said watermark is recognized and said marker 
recovered therefrom. 

Claim 26. A method as claimed in claim 16. 17 or 18 wherein said video like signal 
and said ancillary signal are respectively video and corresponding audio parts of a 
television program. 

Claim 27. A method as claimed in claim 16. 17 or 18 wherein said video like signal 
and said ancillary signal are video and corresponding audio parts of a television 
program respectively and are encoded in MPEG form as part of said signal processing. 

Claim 28. A method of indicating the sync hronizatio n of the video and at least one 
corresponding audio portion of a television program, which video and audio may suffer 
differing relative delays due to transmitting or storing said television program, said 
method including the steps of: 
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a) before said transmitting or storing, developing a digital marker signal in resp onse to 
said audio; 

b) carryin g said marker with said video in said transmitting or storing : 

c) after sa id transmitting or storing, recovering said marker from the resulting delayed 
video; 

d) after sa id transmitting or storing, in response to the resulting delayed audio 
developing a second marker corresponding to said marker of cY 

e) indicating said syn chronization in response to comparison of the relative timing of 
said marker of c) and said second marker. 

Claim 29. A method of maintaining the synchronization of the video and at least one 
correspon ding audio portion of a transmitted or stored television program, which video 
and audio may suffer differing relative delays as part of said transmitting or storing, 
said method including the steps of: 

a) before s aid transmitting or storing, providing a marker in digital form in response to 
said audio: 

b) carrying said marker with said video as part of said transmitting or storing; 

c) after said transmitti ng or storing, recovering said marker from the resulting delayed 
video: 

d) after sa id transmitting or storing, in response to the resulting delayed audio. 
developing a second marker corresponding to said mar ker of c): 

e) in response to the re lative timings of said marker of c) and said second marker. 
delaying th e least delayed of said delayed audio and said delayed video. 

Claim 30. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is engrafted onto the luminous portion of said video. 

Claim 31. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is combined in the active portion of said video. 

Claim 32. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is combined in the active portion of said video in an unobtrusive manner. 

Claim 33. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is combined in the active portion of said video 

Claim 34. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is engrafted onto the luminous portion of said video as a watermark. 
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DELAY TRACKER Tba andio and secondary signals oo (be other band usually 

are passed through devices which have relatively liulo delay 

This is a divisional of copending application Ser. No. compared to the video (although delavs may be present due 

08/620,126 filed on Mar. 21, 1996. to processing similar to the video outline above). Frequently 

ptttt n nv tup twcmttom * there arc several audio channels, for example 2 channels of 

FIELD OF THE INVENTION English, 2 channels of another language, a data channel and 

This invention relates to a method aod apparatus lor a control channel However, when the video signal and the 

accurately ascertaining the processing delay of a signal It is auxiliary signals experience relative timing variations due to 

particularly useful for synchronizing a multiplicity of the changing delays of the different paths, problems occur, 

signals, some of which may have passed through processing 10 foe most commonly noticed one being lip sync error when 

(including transmission systems) having delays, in order to video is dcliyed with respect to the audio. 

resynchronizB the signals at a known point in time. This Variable delay devices exist for delaying signals and it is 

application claims priority to the provisional Application possible at any point in the system to delay the earlier 

60AXK309 filed Dec. 7, 1995— Multiple Video Input Delay Arriving (typically audio) signals) to match the later arriving 

Measurement System, J. Carl Cooper inventor. (typically video) signal However, the problem in making 

_ x w such corrections anses in detecting the delay of the later 

BACKGROUND OF THE INVENTION (typically video) signal which is output from (be system. 

A problem exists in many systems when the various This problem is compounded because the relative delay is 

primary and related signals are processed (including by constantly changing; the delay is often instantly changed as 

transmission and by storage, either direct or indirect, within * s ^S Dal * """d trough different processing devices, and 

a facility aod/or to/from a facility). Examples include video 20 6iSjmii oocs of man y «gnal* are selected to be 

systems wherein there arc many video andVor audio signal P**^ to the output. 

sources from television cameras, tape recorders, direct « ™ c V3 \ Plt - 5,202,761. Audio Synchroniza^on 

feeds, remote feeds from microwave and satellite, not to A^atns, is an attempt to solve some of these related 

mention what might occur to the signal-noise reduction, P***™*- J 61 was added only in 

synchronizers, transcoders, swiu^fkefluics, obscenity 25 F*™" n £" 7*°° ^ only in the vemcd 

droo circuits, etc interval. It therefore would wait until the next vertical 

~L 7^~*. n . , . _ ... interval to add a pulse in the vertical interval This would 

The invention is specifically usable in respect to television function within a certain given accuracy. Since all of the 

signals and will be described with such signals for a pre- video inputs may be totally asynchronous some video sig- 

ferred embodiment For example, a problem exists in many x oals might have their vertical interval pulse added iounedi- 

television facilities when the various video and audio signals aiely. However, others might have to wait nearly a whole 

are processed within the station (or from facility to facility frame to have their pulse added. This gives rise to an 

for that matter). There are also many video signal sources; inherent one frame inaccuracy. Further, various devices exist 

from television cameras, video tape recorders, remote feeds which over write or remove the vertical interval, severely 

from microwave and satellite, together with signal manipu- ^ compromising the '761's performance, 

lations such as noise reduction, etc. There are a ho many These problems are not true in the present invention. In 

audio signal sources; from microphones, tape recorders, this invention, the delay of the signals which pass through 

remote feeds, etc. subject to their own similar processing. the systems are measured through the use of a delay tracker 

Television facilities utilize routing switchers in order that which is associated with the signal This delay tracker is 

the video and audio from any source may be connected to ^ carried with the signal through the system so that, when the 

the input of any video or audio device respectively, with the selected one of the possibly many input signals is output 

outputs of those devices also being connected to the router fr° m tbe system, the presence of the delay tracker can be 

so that the video and audio can be connected to toe input of detected for that (those) signals) by themselves or in 

any other instrument The video and audio may, and fre- combination with other signals. In a preferred embodiment, 

quently do, take entirely different paths having entirely ^ * delay measurement circuit means receives the delay 

different delays. These paths can include many forms of tracker (directly or indirectly as later set forth) and starts 

active and/or passive delays. counting lime. When the delay tracker is detected on the 

It is not uncommon to have a 64 by 64 matrix for each of out of the system, a delay tracker detected signal is 

the auxiliary and video signals. The output signal is fre- 8601 to tbe delay measurement circuit which then stops the 

quently changed in delay by selection of different signal J0 tmie count The time at the stop is thereby a measure of the 

processing paths and selection of different ones of the input °^ & y °f the signal through the system. This measure of 

signals to be output. These router systems give literally *d*Y c** tbuk subsequently used, for example to adjust the 

hundreds of possfcililies for signal path combirurions, with synchronization of the various signals or otherwise, 

the pathsbemg frequently changed to facilitate operational Theory of Operation of the Delay Tracker System 

needs, differing network feeds, local feeds, differing active « t . . . , 

processing drcuits, et al In onter to rtKasw me deby of me signal which passes 

Frequently, the video' processing path involves several <^ tjrtm. a deUy hacker is luwirtas^ed with 

opera.™ is ctooged by Ihe opeSt£, u L pWtf l£ « 2 ^ 50 U 2l^ n 

signals or to the systems reference, or otherwise. Examples i^bX^^l 
include noise reduction systems, synchronizers, transcoders, 

drop out compensators et al OBJECTS AND SUMMARY OF THE 

It is not unusual for the video to suffer delays ranging &s INVENTION 

from near zero to 10 frames of delay or more — i.e. 0J2 It is an object of this present invention to provide an 

seconds before the signal exits the system. improved apparatus and method for detecting and compen- 
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siting for the delays present in processing various signals information about which it is At some time in toe signals Life 

including the transmission thereof. appropriate to measure or determine a delay. 

Another object of Use present invention is to provide an The tracker pulse generator 20 is designated to develop a 

improved apparatus and method for detecting the delays of tracker pulse for the system. While called a pulse for clarity, 

signals ntiimng active portions thereof in order to ensure * it may actually be any type of signal, for example code, 

that the delay tracker passes through the processing means. frequency* burst or alteration of the signal U, as will be 

A further object of the invention is to use recognizable dcs ?** d in J?? oro belc^Purtber, tbe tracker pulse 

tracker pubesYo track a signal through processing!^ te 1 < ? Ufl S w art J f to P 1 "** ™ * bv 

a jjv i .» _ 7T . . . it existent equipment, again as will be described in more detail 

An adA&cnrt objc* of me present invention is to allow 1Q below, llns tracker pulse is generated in recognition with tbe 

fmtteresyncnromzauonofaphi^ type of signal together with the proccssingwmch will or is 

location even afier processing, expected to occur thereon. For cxanrok, with a NTSC video 

Another object of tbe present invention is to provide for transmission system, the tracker pulse could be an amplitude 

a method and apparatus of detecting and compensating for modulated pulse engrafted onto Ibc luminous portion of tbe 

processing delays in a multiplicity of signals. is signal. With a digital system, the tracker pulse may be one 

Further objects of the present invention is to provide for or more extra bit(s) or byte(s) engrafted onto the string of 

a method and apparatus usable with a wide variety of signals digital coding as appropriate for the type of coding. It is 

having differing frequency content including video signals, preferred that the tracker pulse be invisible or imperceptible 

audio signals, microwave signals. X-ray signals, and other to the ultimate use to which the signal will eventually be 

signals. 20 applied. As later described, mis can be provided through 

Other objects and a more complete understanding of tbe subsequent processing as well as careful design. Note that 

invention may be had by referring to the following descnp- **** *° added pulse 21 from the generator 20 is preferred, 

tion and drawings in which: certain parameters, characteristics or ancillary signals 

(herein called artifacts) already present in known signals 

BRIEF DESCRIPTION OF THE DRAWINGS 25 could be utilized as tracker pulses 2L For example, with 

_ _ . . , 4 . , , video signals having a time code expressed thereon, this 

Tbe suueture, operational advantages of the presently ^ ^ ^ JEZd as the tracker pulse, lb utilize the 

enclosed preferred embodiment of the mveiiiioii will ccrUm ^ nt ' mtbcinpai ^ U , tbe artifacts 

become apparent when consadcraUon of the following would ^ recognized Elated at the location of the 

description is taken in conjunction with accompanying M combiner 10. with the recognized artifacts then being passed 

drawings wnerein: to the pulse detector in order that the pulse detector measure 

FIG. 1 is a block diagram of a basic embodiment of the the distance in time between tbe arrival of tho artifacts— in 

invention; specific, that passing through the processing means 30 from 

HO. 2 is a block diagram like FIG. 1 of a two signal mat which is otherwise being passed to tbe pulse detector, 

embodiment of the invention; 35 This can be directly (line 22 in FIGS. 1 and 2) or indirectly 

FIG. 3 is a block diagram like FIG. 1 of a modified (as signal 121 on signal 116 in FIG. 2). Further note that a 

embodiment of tbe invention; known clocking circuit can also be utilized to provide 

FIG. 4 is a block diagram of a video processing system *• ?i' 5? J* ^ fo / 

including the urvention? and two tracker pulse paths to the delay determination circuit 

a . . , , ., B , . , . 40 For example, if The National Bureau of Standards time 

FIG. 5 is a block diagram of a multiple input delay 8igDa t was utilized for coding, it would only be necessary for 

tracking system. the signal^) being tracked to carry the tracker pulse: the 

DESCRIPTION OF THE PREFERRED NJB.S. time signal could be separately and directly acquired 

EMBODIMENTS OF THE INVENTION at lbe determination circuit later described (as via box 

45 23 in FIG. l\ This would preferably be utilized for non- 

Tbe delay tracker system includes a combiner 10, a archival delay tracking of individual signals. (If multiple 

tracker pulse generator 20, a processing means 30, a tracker signals were being processed, the delay determination cir- 

pulse detector 40, a delay determination circuit 50 and a use cuit could subtract one count and/or time cods from another 

60 for tbe delay established through use of the tracker pulse count and/br time code to process same, thus effectively 

(FIGS. 1 and 2). 50 ignoring any common delays— even if measured in years). 

. A combiner 10 serves to associate the tracker pulse from A specialized system wide coding or timing source would 

the tracker pulse generator 20 with an input signal U. The have tbe same result for such a system, albeit not as 

input signal may be any type of signal, whether amplitude, universal 

frequency, phase, digitally coded, or otherwise existent This Tbe delay tracker system is designed to be used with a 

signal 11 includes video signals, audio signals, microwave 55 processing means 30 which preferably has a known maxi- 

signals, x-ray signals, digitalized signals (whether by mum delay. Tbe reason this is important is that it b preferred 

amplitude, width, or other coding technique), and other that the tracker pulse be generated at a rate compatible with 

types of signals having desired information thereon the maximum delay in the system. If greater accuracy is 

(including timing information). Tbe signals may be single, desired, the tracker pulse generator 20 would produce or use 

related multiple signals, unrelated multiple signals, or any so a multiplicity of distinct tracker pulses at a faster rate. Since 

combination thereof including series and parallel forms. tbe multiplicity of pulses are distinct in coding, location, or 

Further, this signal can be acquired for use and used with tbe other ascertainable attribute, they can be separately tracked, 

invention at any point during its creation, subsequent thus significantly reduciDg tbe apparent effective time 

processing, or usage including separate intermediate stages between tracker pulses. Ibis would allow a single signal to 

thereof. For clarity, the signal U will be disensed primarily 65 be tracked with a great precision. This would also allow for 

as a video signal. It is to be understood, however, that this multiple signals to be separately tracked through a single 

terminology includes ant type of signal which contains system. It would also allow a signal with unknown delay to 
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be tracked by using the next recognizable trucker code M the desired to track the four analog signals in respect to tip 

pulse detector before resetting. Note that the tracker pulse video signal Note, in this respect, that since there is rcla- 

generator 20 can be separate for each signal which is passed lively little delay in the audio signals, it would also be 

through the system (FIG. 1), or a single tracker pulse possible to use a single tracker pulse for all four audio 

generator 20 can be utilized for a number of differin g 5 signals. As an additional example, if a time code on a video 

signals. signal was to be used as an tracker pulse, differing time 

H» combiner 10 associates the tracker pulse 21 with the c ? dcs , ooold bc . ua f d as . thc P 11 ^ audio 

rooming signal 11. While this pulse 21 could be at any t W» fB | allowing the delay of the video 

w«tivni« SL <«~««\.,. It u j« n ~t~*~A fK«4 nJ m signal to be separately compensated for in respect to each of 

locauon ra tto incoming signal 61, it is preferred that this auto signals, 

combiner 10 place the tracker pulse 21 at a location where 10 ^ . - , t . 

it is unobtrusive, invisible or imperceptible. This can be J» ^ 12 ^ torn the combiner 10 is subject to 

passive (for example, placing a video tracker pulse into the ^f*? Pf**?*"* **> processing may occasion a 

overscan area of a NI5C television signal) or active (using **** to thesignaL Aspiev^y set fo^ it ispxcferredthat 

an otherwise visible single point 00 an image, preferably *f m9 f mun be known in order to 

displaced from the ccn^a^Tpcrbaps witha siibsequent « -Uow for the puke generator 20 to insert tracker pulses 21 

drop out compensator or averaging mechanism to effectively " a rate d»w *n ^ maximum delay m the system. Note, 

remove the artifacts famine pulse at a downstream however, that if the maximum delay is difficult or not able 

location) to be accurately ascertained, the system could utilize a 

Mi4 w - . , . . . . multiplicity of ever more widely separated recognizable. 

Note that mdrvdual types of ^V*™**^™™ ^foci tracker u ka$t ^ & ^ basidelay 

be designed for each type of signal which is being used, for *> ^ ^ ^ theoretical delay for any type of 

cjumplo analog or digital (as appropriate) versions of processing system. Tuc later described pulse detect 40 

WSC, PAL, component, composite, compressed, serial, would, ooce the delay had been octenmned, preferably reset 

paralleU nme sequential, etc. since m naany systems multiple ^ { ^ ^ ^ 21oftno 8une multiplicity or 

formsof signals are used and crinscoded from an. form to ^ Ugm>rocessing anew with that pulse). TTiesc distmct 

tracker pulses 21 can also be used in aggregate to more 

The combiner 10 associates the tracker pulse(s) 21 at a closely track the delay in the system, by using differing 
known location or position in the signal U. As this point can distinct tracker pulses to measure the delay within the 
be accurately determined for use later in the processing rn»xjmum delay in the system or by using again a multi- 
system the pulse 21 can be subsequently detected. Note that M plicity of tracker pulses like a venier to ascertain delay, 
it is preferred thai the combiner 10 add the tracker pulse 21 Further; in certain systems, the tracker pulse 21 might have 
in an active portion of the incoming video signal. This would to be refreshed at an iitfcrraediatc point. For example in a 
allow the vertical and horizontal intervals to be utilized for digitally encoded audio signal subject to error correction, 
other fonctions and/or allow transcoding and other modifi- there is a theoretical limit that the pulses cannot vary by 
cations to the nature of the signal Again, if the tracker pulse „ more than one half of the clock rate. The reason for this is 
was an artifact, time, frame count or other attribute already that, under this circumstance, an error correction circuitry 
present on the signal, this information would be developed could wipe out the signal With this knowledge, it would be 
by the user for recognition by the combiner 10, with this possible to incorporate an intermediate puke detector sya- 
information being passed to the remaining circuits (for tern with the error correction circuitry in order to ensure that 
example by line 22 in FIG. 1 or 121 in FIC3. 2) as appropriate a fresh tracker pulse is always present on an audio signal, 
for use as a recognizable tracker pulse. The processing system 30 typically adds a delay to one or 

In the delay tracker system it is desired to add the delay more signals in the system, delays that can differ between 

tracker signal at some invisible or unobtrusive part of the signals. This processing system 30 can be transmission, 

video signal or data stream carrying the image. Vertical record/playback, store/reproduce, transcoding, 

blanking or other non-image area may be used. However in 45 synchrooizatioa, noise reduction or any other sort of action 

some systems vertical blanking or various non-image data is which is taken on the signal 12. Some of these events might 

stripped off which would cause the delay tracker signal occur relatively simultaneously (multiple sound rooms for a 

therein to be tost In these systems, the delay tracker signal single live radio broadcasts-while some might occur over 

would preferably be placed in the active image area of the a significant period of time (the archival presentation of 

video signal, for example in one of the extreme comers. 50 video tapes with voice over audio). However, as long as the 

Since virtually all television receivers are oversea noed, the tracker pulse 21 is located on the signal 12, the amount of 

added delay tracker would not be visible to the home viewer. delay will be able to Accurately determined 00 matter what 

Furthermore, if the delay tracker signal is placed in the the processing. 

active video area, then as the video Blgnai fa converted from Surjsequcnl to processing, the now delayed signal 13 is 

SSl5? na * formtl to aoolher ' tor from PAL to 55 present in the system. This signal 13 may be present after all 

NTSC and vice versa, the delay tracker signal will be final processing, or may be intermediate to a series of 

preserved as part of the image. processing steps. 

If multiple tracker pulses were to be utilized with a single The signal 13 is interconnected to a pulse detector 40, 

input signal, it is preferred that the tracker pubes 21 be which pulse detector 40 serves to recognize the tracker pulse 

located at distinct locations on such signal or have such w 21 which is on the delayed signal 13. The pulse detector 40 

distinct attributes that they can be accurately, separately be is designed to recognize the particular type of tracker pulse 

recognned by the later described pulse detection circuit For 21 which is present on such signal 13. In the case of multiple 

example, if one were to track four analog audio signals with tracker pubes, the pulse detector 40 would either recognize 

a single video signal, the tracker pulses could be put in a) the its own pertinent tracker pulse 21 while ignoring other 

four various quadrants of the video signal, b) one in the w tracker pulses that may be present on the signal or, in the 

active picture, one in the overscan* one in the horramtal sync case of multiple tracker pulses for a single signal, would 

period and one in the chrominance., or c) otherwise as react to the multiple tracker pulses even if these tracker 
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pulses 21 are distinct as previously set forth. Note that if tracker pulse coding based on a large scale technique, 

certain artifacts or characteristics already present in the Examples would include the US. Government N.B.S. time 

signal are used as an tracker pulse, additional processing clock (a recognized standard worldwide) or a systems own 

cc^d be necessary to interna main dock Under these circumstances, this information 

^ti^pK\oo(^n&kD^tttnxmm^^^mmto s coM u ukjsa fo m ^ acoondary 

aspcciflcttaie. source 23 for both the tracker pulse and tbc delay detemri- 

Cto » tbMMton Pjlw t??. ^^J^J?**? naubn circuit SO (shown FIG 2). By using such a coding 

oumut 41 a used (FIG. 1) This use could be modifying the u is not necessary to pass tto tracker pulse directly 

Sen Sl^S^^ or u^y?ke 121) m^^^m 

ttpSWCkia 10 is^ara^uirable. iSw^Sd. 

rnotffying aiiotne? signal (such aVdTlay an audio track to &>r example, be appropriate for measuring delays over vast 

synchronize it with a video track) or otherwise as desired. P^^* nctW0lks or ***** » particular networks own 

In the preferred embodiment shown, the detector output u * l0n 8 ^ s * em * 

41 is passed to a delay determination circuit 50 (FIG. 2). In certain instances, the detennination of the delay could 
Also input into the delay determination circuit 50 is a further 15 oe an end in itselt For example, the delay can be used as a 

signal having a relationship to the tracker pulse 21, which measure of quality or efficiency of processing 30. More 

further signal has something with a previously predcter- typically however, the amount of delay once developed is 

mined and thus ascertainable known relaubnsbip with the utilized in some sort of use 60, This could include providing 

signal 11 which was subject to processing. If the tracker * readout of the relative- delay, resyncaronizmg the signals 
pulse 21 is coded with certain specific information— for 20 07 defying 1 attcondary signal 11B, further processing a 

example, the specific point of a specific tine of a television delayed signal 13 or another third signal, or otherwise as 

screen or aSMPTE time code — it is only necessary that the appropriate. A typical use 60 for the invention would be to 

further signal contain the something reflecting the same provide a delay 70 in a signal path, preferably a faster 

relative information. Since the further signal would arrive at secondary signal 136 path, such that the delay deterniination 
the delay determination circuit 50 prior to the tracker pulse 25 circuit 50 controls the delay 70 (shown in dotted lines in , 

output signal 13 (the reason being the slower than the FIG. 2) in order to provide a known relationship between the 

maximum delay) the delay determination circuit 50 can then signals 13 and 1136 at this particular point in the system, 

compare the timing of the output signal 13 to the further A good method of resynchronizing signals is set forth in my 

signal in order to ascertain relative delay caused by the co-pending Application 087486,000 Improved Program 
processing system 30. 30 Viewing Apparatus, the contents of which are metuded by 

This signal may take many forms. Examples inr| "^ the reference, 

direct passage of an tracker pulse to the delay de termination If the tracker pulse 21 was present on the delayed signal 

circuit 50, the passage of an tracker pulse on a second signal, 13 in a form which would be perceived and/or compromise 

the acquisition of tracker pulse information from a second „ the ultimate use of the signal 13, an optional concealer 

source, or otherwise. circuit 80 could be utilized intermediate the pulse detector 

In respect to the direct passage of an tracker pulse, this 40 and the output signal 113A. This concealer 80 would 

would occasion an interconnection between the pulse gen* remove or otherwise reduce the negative effects of tracker 

erator to the delay determination circuit 50 (line 22 in FIG. puke 21 . An example would be with an error control circuit. 

2). This would, for example, be appropriate for tracking a ^ This circuit replaces the delay tracker signal with a video 

single signal through processing, with or without subsequent signal which is taken from the preceding line of video or 

manipulation of such signal. other suitable video as is well known. This replacement may 

In respect to the passage of an tracker pulse on a second be performed with a standard Dropout Compensator (DOC), 

signal if desired, in addition or instead of tracker pulse The DOC receives a signal indicating the position and 

coding, the tracker putse generator 20 could send a second- 45 occurrence of the delay tracker signal from the delay tracker 

ary tracker pube 121 to a secondary combiner 106 on the detector to cause the concealment of the delay tracker signal, 

secondary signal 116 (FIG. 2). Under these circumstances, It could also include means to conceal the tracker pube — for 

the delay determination circuit 50 would compare coded example, by modifying or averaging the pube 21 with other 

tracker pulses from two detectors 40, 406 in order to surrounding signals to reduce its obtrusiveness. A dropout 

ascertain the relative delay between the signals 13 and 136. 50 compensator would accomplish this purpose in a video 

This would, for example, be appropriate for delaying the circuit application, 

faster signal (136 in FIG. 2) by a delay in order to synchro- There are many modifications and permutations which 

nize the two signals 13, 136. can be made to the invention of this application without 

Note that when two signals are known to be tracked for a turning from its teachings, Examples are shown in FIGS. 3, 

significant length of time, encoding the tracker pube 21 with 55 4, and 5. 

its data on the associated second signal would provide for a | n no. 3, mcrc m two signals U and 116 which are 
higher degree of accuracy than merely passing the tracker being separately tracked through a processing means 30, 
pube 21 directly 10 the delay determination circuit The 306. This processing means canbe a single related process- 
reason for this is that the associated signal could itself bo fog means for both signals, optionally, the second signal 116 
subjected to some minor processing delays, processing eo could pass through a separate processing means 306 (as 
delays which would not be present if the tracker pube was shown). Both signals shown have their own unique tracker 
passed directly to the delay determination circuit. An pulse generators 20, 206. If desired, a synchronizer 25 could 
example of this would be the audio of a television circuit be added to cordate the tracker pulses 21, 216 in a predict- 
being run through its own noise leo^ctmoprocessmg circuit able manner. Tnis could include full synchronization 
prior to being reassoctated with the processed video signal. 65 (although in this situation, it might be simpler to use a single 
In respect to acquisition of an tracker pulse from a tracker pulse generator for both signals), it could be with a 
secondary source, this would result from the use of an known reUtionship between the two pulses 21 and 21a (for 
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example, to compensate for the repetitive mture of the be, oae of the signals being processed). When the proper 

signals and/or the differing delays to be expected in the video location is present, the combiner 10 encodes the then 

processing means 30. 306), oz otherwise. The use of the current count in the input signals) at the appropriate 

separate tracker pulse generators 21, 21b is preferred in that position, for example in the active video, overscan, the 

it allows each signal 11, 116 to be individually tracked (i.e. s vertical blanking or otherwise as desired, 

recognized by their respective pulse detectors 40, 406). lb ^Uow fc> r processing of the tracker pulse 21, it is 

Toe two tracker pulses 21, 216 are detected by their ap pr opri ate to have a capacity to count greater than actually 

respective pulse detectors 40, 406 in order to determine the expected to allow for tolerances and operational speeds of 

appropriate delays between the tracked signals. This is the the system. Note also thai if an incompatible video or other 

relationship between signal 13 and 136, the relationship 10 auxiliary signal incorporated the tracker pulse appropriate 

between signal 136 and signal He, and (indirectly) the coding suitable for the signal may be required. For example, 

relationship between signal 13 and signal 11c. By varying if an analog audio signal would carry the tracker pulse 21, 

the interconnections of the various delay extermination an intermittent high frequency carrier of 22 khz could be 

circuits, other variations are also possible* utilized to carry the same example 12 bits of information 

Onccthec^Uyis&termine^^ 15 with suitable accuracy. 

3 it is used to synchronize the signals 113 and 1136 and to The tracker pulse signal 21 shown in FIG. 5 is as set forth 

synchronize the sigoal 1136 and 113c a binary number which is clocked by a reference video H. In 

An optional coordinator 45 keeps track of the respective ^ svstem with multiple asynchronous video signals, the 

tracker pulses 21, 216. This would allow the operator to keep count is locked to a reference (in this case a reference video 

track of the actual signals which are passing through the 20 sign*! 13). and the same binary count is applied to all the 

pulse detectors 40, 406, thus providing the operator with delay tracker combiners 10. When the count is subsequently 

information which would be otherwise not readily available. recovered from the delayed video by the detectors 40, it is 

Tbcy would also allow an operator to synchronize signals subtracted from the current count by a delay determination 

113 to 1136 and, in addition, to signal 113c. Other types of circuit SO including a difference calculator to give the 

multi signal syocbronization and compensation could also 15 number of video hoes of delay which the video signal has 

be occasioned by this system. experienced in the system. The lines of delay ascertained by 

FIG. 4 reflects a further implementation of the invention. ^ deto nn in * tor 50 are converted to milliseconds, seconds 

A tracker pulse generator creates the tracker pulse 21. The or othcr suiubte delay measure and a delay signal is output 

1 particuUrtrackerpulse21 is generated in response to a video „ j?* 1 ™ * etching delay 101 in an auxiliary signal path, a 

signal 11, for example every 10 frames. Further, by using an delay such as the Pixel Instruments AD3100. Again, tudio or 

additional circuit (a line counter 27 shown) the tracker pulse 01her auxiliary signals could also be used with the system, 

can be combined with the line number and timing inforraa- " is preferred that all of the video signals carry the 

q'oq 28 of the video input 11. This allows the tracker pulse encoded delay tracker signal through the video processing 

21 to be specifically coded with this pertinent information, # system so that, no matter which signal is selected as the 

thus creating a distinct and recognizable pulse, a delay output, there will be a delay tracker on it allowing the delay 

tracker. The particular tracker pulse 21 shown thus includes to Dc measured. In the event a signal without a delay tracker 

a binary count which is incremented at the H rate of the ** output, the difference calculator can be preset to output a 

reference signal. Thus there is a unique binary number for default delay value, which may be preset or operator adjust- 

every line of video, and a unique number corresponding to ^ , * 3lc * 

the time when the signal b added to video. The combiner 10 This system has some real advantages. First, it is cheap to 

encodes the current delay tracker in the video frame during implement for multiple video signals. The delay tracker 

which the tracker pulse 21 was received as previously set combiner cost is divided by S250 per video channel The 

forth. delay detector and calculator b around $4,500. Of course, 

After the tracker pulse 21 is combined with the input 45 0JU V one delay detector is needed per system although more 

signal 11 it is passed through the processing means 30 in the can be used for corrections at intermediate points, 

customary manner. Subsequently, the delay trackor detector Although the invention has been described in its preferred 

40 ascertains the delay occa^oned by the processing and, in form with a certain degree of particularity, it is to be 

addition, replicates the line number corresponding to the understood that numerous changes can be made without 

location of the delay tracker signal(s). This information is 50 departing from the invention as hereinafter claimed, 

then used as appropriate to ascertain the delays in the What is claimed Is: 

system. In addition, the concealer circuit 80 removes or 1. In a signal processing system having a signal having 

otherwise reduces negative effects the delay tracker signal so desired substantive information thereon passing through a 

as to provide for an uncorrupted video output delay, which delay may change, 

In FIG. 5, a system amplifying the device of FIG. 4 is 55 the improvement of a delay tracker, said delay tracker 

shown for one video channel (parts of this system are comprising a tracker puke, means to associate said 

duplicated for each channel). In this device again a sync tracker puke with the signal having desired substantive 

stripper and line counter keep track of which line of the information thereon, 

video signal is currently present for use on the tracker pulse a puke detector means, means to associate said pulse 

21 (ref video 15 in). The particular preferred embodiment 60 detector means with the processing system and said 

counts at the horizontal sync rate to develop a specific count pulse detector means recognizing said tracker pulse to 

for the tracker pulse 21. The actual count would vary with develop a determination of the delay of said tracker 

the anticipated maximum delay of the processing 30. For a pulse. 

typical NTSC system having a horizontal characteristic of 2. In a signal processing system having a signal having 

52S lines per frame, 2625 counts would allow a 10 field 65 desired substantive information thereon, the signal having 

delay (or 12 bits of binary information on the tracker pulse desired substantive information thereon may have a chang- 

21). (Note this reference video can be, but does not have to ing delay due to changes in the processing system, 
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the improvement of a delay trucker, said delay tracker 
comprising a recognizable tracker pulse, means to 
associate said recognizable tracker pulse with the signal 
having desired substantive information thereon, 

a pulse detector means, means to associate said pulse 
detector means with the processing system and said 
pulse detector means recognizing said recognizable 
tracker pulse and further operative to develop a mea- 
sure of the delay of said tracker pulse. 

3. In a signal processing system having an incoming 
signal having desired substantive information thereon pass- 
ing through a processing means having a delay, which delay 
may vary in respect to differing signal processing systems, 

the improvement of a delay tracker comprising a tracker 
pulse, 

a combiner means to associate said tracker pulse with the 
incoming signal having desired substantive information 
thereon prior to the incoming signal having desired 
substantive information thereon passing through the ^ 
processing means, 

a tracker pulse detector means to recognize said tracker 
pulse on the signal having desired substantive infor- 
mation thereon coining from the processing means and 
to determine the delay of said tracker pulse, and use 35 
means responsive to said tracker pulse detector means. 

4. The delay tracker of claim 3 characterized in that said 
use means includes a delay determination means determin- 
ing the delay caused by the processing means* 

5. The delay tracker of claim 1 characterized by means to 30 
determine the amount of delay from said recognized tracker 
pulse. 

6. The delay tracker of claim 1 characterized by the 
addition of means to generate a measure of the delay in 
response to said recognition of said tracker pulse. 

7. The delay cracker of claim 2 characterized by means to 
determine the amount of delay from said recognized tracker 
pulse. 

8. The delay tracker of claim 2 characterized by the 
addition of means to generate a measure of the delay in 
response to said recognition of said tracker pulse. 



35 



9. The delay tracker of claim 3 characterized in that said 
use means indv^ ff* a means to determine) the amount of 
delay from said recognized tracker pulse. 

10. The delay tracker of claim 1 characterized in that said 
use means includes means to generate a delay signal in 
response to said pulse detector means. 

U. A method for tracking a delay in a signal processing 
system having a signal having desired substantive informa- 
tion thereon passing through a delay, which delay may 
change due to variations in the signal processing system, 
the method comprising associating a tracker pulse with 
the signal having desired substantive information 
thereon, using a pulse detector means associated with 
the processing system to recognize the tracker pulse to 
develop a determination of said delay in response to 
said tracker pulse. 

12. A method for tracking a delay in a signal processing 
system having a signal having desired substantive informa- 
tion thereon, the signal may have a changing delay, 

the method comprising associating a recognizable tracker 
pulse with the signal having desired substantive infor- 
mation thereon, using a pulse detector associated with 
the processing system to recognize the recognizable 
tracker pulse to develop a determination of said chang- 
ing delay responsive to said tracker pulse. 

13. A method for tracking a delay in a signal processing 
system having an incoming signal having desired substan- 
tive information thereon passing through a processing means 
having a delay that may change. 

the method comprising using a combiner means to asso- 
ciate a tracker pulse with the incoming signal having 
desired substantive information thereon prior to the 
incoming signal having desired substantive information 
thereon passing through the processing means, recog- 
nizing the tracker pulse on the signal having desired 
substantive information thereon coming from the pro- 
cessing means, and using said tracker pulse detector 
means to develop a determination of the delay of said 
tracker pulse to track said delay that may change. 
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